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MULTI-MEDIA COMMUNICATION MANAGEMENT 



CROSS-REFERENCE TO RELATED ACTIONS 

This application claims the benefit of, and is a continuation in part of United 
States Patent Application 10/000,543 filed on October 23, 2001, entitled "Modular Multi- 
Media Communication Management System," that is a continuation in part of United 
States Patent Application 09/961,532 entitled "Teledata Space and Docking Station with 
Modular and Integrated Display" filed on September 24, 2001, the contents of both such 
patent applications being incorporated herein. 

FIELD OF THE INVENTION 

The invention relates generally to managing multi-media conmnmications, and 
more particularly to a modular system for managing video conference communications. 

BACKGROUND OF THE INVENTION 

Multi party calls or conference calls have provided a convenient method for 
enabling remotely located individuals to orally participate in a meeting. Many existing 
PBX systems enable the operator of a desk top telephone to place calls to multiple parties 
and conference the multiple parties together. The PBX estabUshes a circuit switched 
connection with each participant (whether on the public switched telephone network 
(PSTN) or the private network controlled by the PBX) and then bridges the lines 
together. 

One problem associated with such a system is that the operator of the desk top 
phone must initiate the conference call by dialing each participant and using an 
appropriate conference button(s) and/or a hold button(s) to bring all participants together. 
Such a process is time consuming at best. And, if an operator is not famihar with the 
telephone system, such a process may require reliance on a manual to properly activate 



the correct button sequences to dial each participant to initiate the call. 

Another problem associated with such systems is that audio quality degrades 
when participants are added. The voice volume of each participant may be unequal and 
background noise from each line is aggregated into the conference. Typically audio 
5 quality becomes unacceptable when greater than three participants are connected. 

More recently conferencing bridge systems have been developed to improve 
conference call quality. Typically each participant will dial into a conferencing bridge 
and enter a pass code to join a conference. The conferencing bridge includes signal 
processing circuits for reducing background noise, echo cancellation, and balancing the 
10 volume of different speakers. 

A problem with conferencing bridge systems is that the conference call must be 
scheduled with the bridge and each caller must call into the bridge. Therefore, if the 
operator of a desk top telephone desires to set up a conference call with four participants, 
the operator must first schedule a call with the bridge and set a pass code for participants 
15 to use when calling into the bridge. Secondly, the operator must notify each participant 
of the dial-in number to the bridge and the pass code to enter the conference. This is at 
least as cumbersome as dialing all four participants and utilizing the PBX for the 
conference. 

Another problem associated with both the PBX system and the bridge system is 
20 that there exists no convenient system for monitoring participation in the conference call. 
In the bridge system, a participant could manually track entries and departures based on 
the system notifications, manually tracking entries and departures to determine who is 
participating in the call at any given time is subject to error, distracting, and 
cumbersome. 

25 Yet another problem associated with the known conferencing systems is that they 

do not provide a system for two or more remote participants to converse in private such 
that they can hear each other but can not be heard by the other participants. 

What is needed is a multi media communication management system that 



provides audio and video conferencing services that does not suffer the disadvantages of 
the existing communication systems. 

SUMMARY OF THE INVENTION 
5 The multi-media communication management system comprises a controller that 

interfaces with a pliirality of commimication space stations, and their associated 
subscriber device(s), and with one or more communication medium service providers. 

The controller translates multi-media communications received from a multi- 
media service provider into the protocols required for use by the communication space 

10 stations as well as any conventional telephone stations that may be coupled to the 
controller. The communication and control signaling between the controller and the 
communication space stations may be wireless in nature with the communication space 
stations each powered by an internal battery and/or connection to a local source of 
conventional line power. 

15 The architecture of the communication space station is modular. Multiple 

functional elements can be interconnected with backbone commimication circuitry to 
form an integrated communication platform. Modular docking interfaces may be used to 
couple the space station communication device to portable subscriber devices and to 
enable integrated and coordinated communication through multiple communication 

20 medium service providers. This coordinated and integrated system architecture enables 
the space station commimication device to merge the fimctionaUty and internal data of 
the various portable subscriber devices into the space station commimication device, to 
direct the functionality and data of the space station communication device to a selected 
one of the portable subscriber devices, and to provide the subscriber with a simple 

25 subscriber interface. 

The multi-media communication services provided by the controller may include 
audio/video conference call mixing. The controller may estabhsh an audio or an 
audio/video communication session with each of a plurality of communication space 

4 



stations and telephones or video telephone systems coupled to the communication 
medium. 

A participant of an audio/video conference session may utilize a communication 
space station for controlling the session, establishing and terminating side conversations, 
5 putting certain participants on hold, and selecting amongst multiple video signals for 
viewing. 

In general, in an aspect, the invention provides a packet-switched data 
communication system including a network interface configured to couple to a packet- 
switched network, a communication session module coupled to the network interface and 

10 configured to establish a communication session with a telecommunication device 
through the packet-switched network, a communication processing module coupled to 
the network interface and configured to receive real-time communication data, arrange 
the communication data in a sequence of packets, and send the sequence of packets to 
the network interface, and an encryption module coupled to the communication 

15 processing module and configured to selectively encrypt the received communication 
data in response to an encryption indication received via the network interface. 

Implementations of the invention may include one or more of the following 
features. The encryption indication is indicative of an encryption request initiated by a 
user of the telecommimication device. The encryption indication is the received real- 

20 time communication data being encrypted. The communication session module is 
configured to estabUsh communication sessions with multiple telecommunication 
devices through the network, and wherein the commimication processing module is 
further configured to provide a security indication to at least a first of the 
teleconmiunication devices through the network interface indicative of whether 

25 conmiunications from the network interface toward a second of the telecommimication 
devices is secure. The security indication is indicative of whether communications are 
encrypted. The system includes the first of the telecommunication devices, the first 
telecommunication device being coupled to the network interface and configured to store 



a public encryption key and to provide the public encryption key to the encryption 
module. The first telecommunication device includes a secure conmiimication selector 
and is configured to provide the device encryption key to the encryption module in 
response to actuation of the secure communication selector. The first telecommunication 
5 device fiirther includes a docking port for receiving a portable communication device, the 
first telecommunication device being further configured to provide an encryption 
indication to the docking port to cause the portable communication device received by 
the docking port to display an indication that communications fi-om the first 
telecommunication device to the network interface are encrypted. The first 

10 teleconranmication device fiirther includes a docking port for receiving a portable 

communication device, the first telecommunication device being further configured to 
process the security indication and to provide the processed security indication to the 
docking port to cause the portable communication device received by the docking port to 
display an indication that communications fi-om the network interface to at least the 

15 second telecommxmication device are seciu"e. 

In general, in another aspect, the invention provides a telecommunication device 
for communication with a communication endpoint device via a packet-switched 
network, the telecommunication device including, in combination, an interface 
configured to couple to the network, a microphone for receiving sound signals, a speaker 

20 for providing sound signals corresponding to signals received via the interface firom the 
network, and a data processing module coupled to the interface and configured to receive 
data fi-om the interface, process the received data, and to provide an indication for 
causing a display at least temporarily associated with the teleconmiunications device to 
display an indication of whether communications between the telecommunications 

25 device and the endpoint device are secure. 

Implementations of the invention may include one or more of the following 
features. The telecommunication device fiirther includes a device encryption module 
coupled to the interface and configured to store a pubUc device encryption key and to 



provide the public device encryption key to the interface for transmission to the endpoint 
device. The telecommunication device further includes a secure communication selector 
and is configured to provide the public device encryption key to the interface in response 
to actuation of the secure communication selector. The telecommunication device 
5 further includes a docking port for receiving a portable communication device, the device 
encryption module being further configured to provide an encryption indication to the 
docking port to cause a portable communication device received by the docking port to 
display an indication that communications from the telecommunication device to the 
endpoint device are encrypted. The data processing module is further configured to 

10 receive a security indication received by the interface and to provide the encryption 
indication to the docking port in response to receiving the security indication. 

In general, in another aspect, the invention provides a method of providing secure 
communications between a plurality of communication units, the method including 
conveying a first communication from a first conrnnmication unit to a second 

15 communication imit, the first communication being unsecure, determining v^hether a 
user-actuated selector to secure communications from the first commvmication xmit to at 
least the second communication unit is currently actuated, and conveying the second 
communication from the first conrnnmication unit toward the second communication imit 
in a secure manner if the selector is currently actuated. 

20 Implementations of the invention may include one or more of the following 

features. The method further includes encrypting the second communication if the 
selector is actuated, wherein conveying the second communication comprises conveying 
the second, encrypted, communication. The second communication unit is a control unit 
configured to relay communications from the first conununication unit to a plurality of 

25 third communication units, the method further including receiving at the second 
commimication imit, an indication that the second communication is encrypted, 
decrypting the second communication to produce a decrypted second communication, 
encrypting the decrypted second communication in accordance with encryption keys, if 



available, associated with the third communication imits to produce re-encrypted second 
communications, and conveying the re-encrypted second communications from the 
second communication unit to the respective third communication units. The method 
further includes providing security indicia to the first communication unit indicative of to 
5 which third communication units the second commimication unit transmits re-encrypted 
second communications, and displaying, on a display associated vnth the first 
commimication unit, whether conmiunications between the second communication unit 
and the respective third communication unit are secure. 

Implementations of the invention may also include one or more of the following 

10 features. The method further includes displaying on a display associated with the first 
communication unit that communication between the first conmiunication unit and the 
second communication unit is secure. The second conmiunication unit is a control unit 
configured to relay conmiunications from the first communication unit to at least a third 
communication unit, the method further including receiving, at the second 

15 communication unit, an indication that the selector is actuated, and conveying the second 
communication from the second communication unit to the third commimication unit in a 
secure manner. 

In general, in another aspect, the invention provides a communication system for 
bridging communication sessions into a conference call, the system including at least one 

20 network interface configured to couple to a packet-switched network, a session module 
coupled to the at least one network interface and configured to establish communication 
sessions with a plurality of conference-participating devices through the at least one 
network interface via the packet-switched network, a signal-mixing module coupled to 
the session module and configured to mix audio streams from the conference- 

25 participating devices and to supply mixed streams toward the conference-participating 
devices, and security means, coupled to the at least one network interface and to the 
signal-mixing module, for securing communications from the signal-mixing module in 
response to a secure communication indication. 

8 



Implementations of the invention may include one or more of the following 
features. The secure communication indication is a security signal received via the at 
least one network interface from a conference-participating device. The security means 
is configured for notifying at least one of the conference-participating devices to which, 
5 if any, of the conference-participating devices the mixed signals are sent in a secure 
manner. The securing communications includes encrypting the mixed streams. The 
securing conmiunications includes directing the mixed signals to limited-access secure 
lines via the at least one network interface. The security means is configured for 
decrypting incoming encrypted audio streams. The secure communication indication is 

10 an indication that an incoming audio stream is encrypted. 

In general, in another aspect, the invention provides a teleconmiunications station 
for transducing at least one of soimd and video signals to outgoing electronic signals and 
sending the outgoing electronic signals over a teleconmiunications line and for 
transducing incoming electronic signals received via the telecommxmications line to 

15 incoming media signals being at least one of incoming sound signals and incoming video 
signals, the telecommunications station comprising in combination an interface module 
configured to establish a communication session between the station and a 
commxmication endpoint over the telecommunications line, secure session means for 
detecting operator request for at least secure outgoing communications over the 

20 telecommxmications line and providing an indication for secure outgoing 

communications, and an encryption module coupled to the secure session means and 
configured to encrypt outgoing electronic signals in response to the indication for secure 
outgoing communications provided by the secure session means. 

Implementations of the invention may include one or more of the following 

25 features. The secure session means is also for detecting an endpoint request, received via 
the telecommunications line, for at least secure incoming communications and providing 
an indication for secure incoming communications, and wherein the encryption module is 
further configured to decrypt incoming electronic signals in response to the indication for 



secure incoming communications provided by the secure session means. The indication 
for secure incoming commimications and the indication for secure outgoing 
commvmications are the same indication. The station further includes means for 
indicating secure status of communications from the station via the teleconununications 
line. The means for indicating secure status comprises means for receiving participant- 
security indications via the telecommunications line indicative of whether 
commimications to each of multiple conference-call participants are secure. The means 
for indicating secure status indicates secure status of a conference-call only if the 
participant-security indications indicate that communications to all of the conference-call 
participants are secure. 

Various aspects of the invention may provide one or more of the following 
advantages. Communication encryption can be user-activated. Indicia of whether 
communications are secure can be provided to confirm the security of the 
communications. 

These and other advantages of the invention, along with the invention itself, will 
be more fully understood after a review of the following figures, detailed description, and 
claims. 

BRIEF DESCRIPTION OF THE FIGURES 

Figure 1 is a block diagram view of a modular multi-media communication 
management system in accordance with one embodiment of the present invention; 

Figure 2 is a block diagram of a multi-media communication management system 
controller in accordance with one embodiment of the present invention; 

Figure 3 is a perspective exploded view of a modular conununication space 
station in accordance with one embodiment of the present invention; 

Figure 4 is a block diagram of a communication space station in accordance with 
one embodiment of the present invention; 

Figure 5 is a block diagram of a subscriber data assistant in accordance vsdth one 
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embodiment of the present invention; 

Figure 6 is a block diagram of a wide area network communication device in 
accordance with one embodiment of the present invention; 

Figure 7 is a block diagram of a wireless dialog handset in accordance with one 
embodiment of the present invention; 

Figures 8a is a table diagram representing a current network location table in 
accordance with one embodiment of the present invention; 

Figure 8b is a table diagram representing a multicast group table in accordance 
with one embodiment of the present invention; 

Figures 9a through 9j each show a flow chart representing processing steps 
performed by a multi-media communication management system in accordance with one 
embodiment of the present invention; 

Figures 10a through lOh each show an exemplary display of information to a 
subscriber utilizing a subscriber interface of a communication space station in 
accordance with one embodiment of the present invention; and 

Figures 1 la through 1 Ic each show a flow chart representing exemplary operation 
of packet audio/video gateway in accordance with one embodiment of the present 
invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

The present invention is now described in detail with reference to the drawings. 
In the drawings, each element with a reference number is similar to other elements with 
the same reference number independent of any letter designation foUowring the reference 
number. 

It should also be appreciated that many of the elements discussed in this 
specification may be implemented in hardware circuit(s), a processor executing software 
code, or a combination of a hardware circuit and a processor executing code. As such, 
the term circuit or module as used throughout this specification is intended to encompass 
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a hardware circuit (whether discrete elements or an integrated circuit block), a processor 
executing code, or a combination of a hardware circuit and a processor executing code, 
or other combinations of the above known to those skilled in the art. 

Referring to Figure 1, an exemplaiy architecture of the multi-media 
communication management system 10 of the present invention is shovm. The multi- 
media communication management system 10 includes a control unit 12 that is coupled 
with a plurality of local communication devices 20 over a wireless local area network 22 
(or by a wired network connection 23 to the backbone wired network of the wireless 
local area network 22). The local communication devices 20 may iriclude: subscriber 
stations 24 (communication space stations 24), wireless dialog handsets 26, traditional 
telephone handsets 28, traditional fax machines 30 (both coupled through communication 
space station 24), traditional computer systems 32, network printers 46, and various 
network appliances 34. 

The control unit 12 includes a circuit-switched provider bay 19 which operatively 
couples the control unit 12 to the public switched telephone network (PSTN) 42 and 
includes a multi-media communication service provider bay 14 which operatively 
couples the control unit 12 to a multi media service provider's network 18 through one of 
a plurality of communication medium modules 16a-16d. 

In the exemplary embodiment, the service provider's multi-media communication 
network 1 8 may utilize the Intemet Protocol Suite for communication at the IP level, but 
may be proprietary at the data link and physical layers. As such, the control unit 12 
includes the IP stacks applicable for communication between applications over the 
network 18 and each module 16a-16d includes the applicable data link and physical layer 
circuits for communication of IP fiames over the physical medium of the network 18. 

Some illustrative examples of communication modules include: communication 
module 16a which may be a cable modem module for communicating over coaxial cable 
36 with a multi-media conununication service provider such as a local cable company, 
communication module 16b which may be a wide area network radio for conmiunication 
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over a wireless spectrum channel 38 with a wide area wireless multi-media 
communication service provider such as an analog or digital cellular/PCS telephone 
service provider, conrniimication module 16c which may be a customer service unit 
(CSU) for communication over a Tl line 40 with a multi-media commimication provider 
such as a local telephone service provider, and communication module 16d which may 
be an optical modem for communication over a fiber channel 44 with a fiber optic multi- 
media communication service provider. 

In operation, the control unit 12 integrates and manages multi-media 
commimication between two or more local communication devices 20 and between each 
local communication device 20 and a remote communication system(s) (not shovm) 
coupled to either the service provider's multi-media commimication network 18 or the 
PSTN 42. 

Figure 2 shows a block diagram of an exemplary control unit 12. The control unit 
12 includes applicable modules for managing the local area network 22 as an IP network. 
Such modules may include an applicable combination of hubs, routers, and switches 29 
for managing communications over the network 22 as well as an address server 220 (e.g. 
DHCP server) for assigning local IP addresses to each local communication device 20. 

The control unit 12 may also include a packet audio/video gateway 232, a voice 
mail module 236, an email module 228, and a web server application 230. 

Packet Voice Gateway 

The packet audio/video gateway 232 provides a subscriber's real time full duplex 
audio and audio/video call and conference call services. The services may include 
routing and maintaining a subscriber's outgoing calls, a subscriber's incoming calls, and 
a subscriber's conference calls. 

A subscriber's outgoing calls are calls initiated by the subscriber utilizing a space 
station 24. A subscriber's incoming calls are calls initiated by a remote caller to the 
subscriber. 
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Each call takes place over a real time communication session between the space 
station 24 serving the subscriber and a remote device serving the other call participant. 
The remote device may be another space station 24, a packet audio/video device coupled 
to the service provider network 1 8, or a PSTN device coupled to the PSTN 42. 
5 A real time commimication session between the space station 24 and another 

space station 24 or a packet audio/video device coupled to the service provider network 
18 will be a VOIP session with the space station 24 being one endpoint of the VOIP 
session and the other space station 24 or the packet audio/video device being the other 
endpoint. 

10 A real time commimication session between a space station 24 and a PSTN 

device coupled to the PSTN 42 comprises a VOIP session between the space station 24 
and the gateway 232 plus a PSTN session between the gateway 232 and the PSTN 
device. In this case, the space station 24 and the gateway 232 are the two endpoints of 
the VOIP session and the gateway 232 and the PSTN device are the two PSTN endpoints 

15 ofthe PSTN session. 

Establishing and managing a VOIP session between two endpoints includes 
exchanging session signaling messages, channel negotiation messages, compression 
capability messages, and optionally encryption capability and key messages between the 
two endpoints utilizing predetermined message protocols such as the Session Initiation 

20 Protocols (SIP) established by the Internet Engineering Task Force (IETF). The 
messages are exchanged utiUzing UDP/IP datagrams transferred between the two 
endpoints over the network 22 and the service provider network 18. The gateway 232 
operates as an address directory for locating an endpoint on the local area network 22 and 
as an IP layer proxy for exchanging datagrams between the two endpoints. 

25 After a VOIP session is estabUshed, communication of audio (and video) data 

between the two endpoints comprises compressing digital audio data into a sequence of 
RTP frames, optionally encrypting the RTP frames, and sending the RTP frames to the 
other endpoint utilizing UDP/IP datagrams on the negotiated channels. At the other 
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endpoint, the UDP/IP datagrams are received, sequenced, and the RTP frames are 
recovered, decrypted if appHcable, and decompressed to yield the digital audio data. 

Establishing a PSTN session between two PSTN endpoints includes use of 
standard PSTN analog or PSTN digital signaling and, after the PSTN session is 
S established, commimication of audio data between the two PSTN endpoints comprises 
standard PSTN analog or PSTN digital communications. 

A multi-party conference call initiated by the subscriber to a plurality of callee 
participants comprises a VOIP session between the space station 24 supporting the 
subscriber and the gateway 232 plus a plurality of participant sessions. These participant 
10 sessions are VOIP sessions and/or PSTN sessions, each between the gateway 232 and a 
participating space station 24, packet audio/video device coupled to the network 18, or 
PSTN device coupled to the PSTN 42. 

The gateway 232 comprises a PSTN interface module 19, a call signaling module 
227, a relay module 229, a conference mix module 237, and a compression/encryption 
15 module 240. 

The PSTN interface module 21 includes circuits for translating between PSTN 
session signaling (and analog or PSTN digital audio communication) and digital session 
signaUng messages (and digital audio communication formats and protocols) for use by 
the other elements of the packet audio/video gateway 232. 

20 The call signaling module 227 includes a routing circuit, a session signaling 

circuit, and a directory circuit that work in combination to provide: i) routing of a 
subscriber's incoming calls to a space station 24 that is then serving the subscriber or to 
voice mail; ii) routing the subscriber's outgoing calls to another space station 24, a 
packet audio/video device on the network 18, or to a PSTN destination; and iii) 

25 establishing calls between the gateway 232 and each conference participant. The routing 
circuit provides for routing session signaling messages between the two VOIP endpoints 
when the gateway 232 itself is not one of the endpoints. The session signaling circuit 
generates session signaling messages and establishes a VOIP session on behalf of the 
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gateway 232 if the gateway 232 is an endpoint of the VOIP session being established 
(e.g. a session between a space station 24 and a PSTN device or a conference call 
including the space station 24). 

With respect to a subscriber's outbound calls (and with respect to a subscriber's 
5 conference calls), the directory receives session signaling messages, from the 

subscriber's space station 24 (or from the conference mix module 237 if a conference 
call) and that includes a number identifying the callee, and routes the call to the callee. 
The niraiber identifying the callee may be a 10 digit number representing a subscriber 
loop of the PSTN 42, a number identifying a person operating a packet audio/video 
10 device coupled to the network 18, or a subscriber ID representing a subscriber to the 
system 10. 

If the number represents a packet audio/video device coupled to the network 18, 
the number may be pemianently assigned to the device. The IP network address utilized 
by the device, however, may change periodically. As such, the directory circuit may 

15 query a remote directory server to determine the network address of the device (or the 
network address of a proxy for the device) and provide the network address to the space 
station 24 such that it may initiate session signaling directly to the device or the proxy. 

If the number represents a subscriber loop of the PSTN 42, the directory circuit 
provides the number to the PSTN interface 21, such that the PSTN interface circuit may 

20 establish a PSTN session with a PSTN device coupled to the subscriber loop. The 
director circuit also instructs the call signaUng module 227 to respond to the call 
signaling to establish a VOIP session between the space station 24 and the gateway 232. 

If the destination device is a subscriber to the system 10, steps discussed below 
with respect to receiving an inbound call for a subscriber are applicable. 

25 With respect to a subscriber's inboimd calls, the directory circuit receives session 

signaling messages from a caller device that identifies a subscriber as the callee, and 
routes the call to the particular space station 24 that is then servicing the subscriber or, if 
the subscriber is not served by a space station 24 or is ahready participating in a call, 
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routes the call to the voice mail module 236 such that the caller may leave a message for 
the subscriber. 

Referring to Figure 11a in conjunction with the current network location table 
245 of Figure 8a, the process of identifying the space station 24 servicing the subscriber 
is shown. 

Step 600 represents receipt of the session signaling message identifying the 
subscriber. In the exemplary embodiment, each subscriber will be assigned a four digit 
subscriber identifier nimiber that corresponds to the last four digits of a PSTN direct dial 
number that routes to the PSTN interface 21 when dialed on the PSTN. As such, the 
session signaling message, whether originated by a packet audio/video device coupled to 
network 18, a space station 24 coupled to the network 22, or the PSTN interface 21 (in 
response to PSTN session signahng), may include the subscriber identifier number to 
identify the destination subscriber. 

At step 602, the directory circuit identifies a subscriber device 50 (Figure 1) that 
is associated with the identified subscriber utilizing the network location table 245. To 
associate each subscriber with his or her subscriber device 50, the network location table 
245 includes a record for each subscriber. Within such record is a field that identifies the 
subscriber, identifies tiie four digit subscriber identifier associated with the subscriber, 
and identifies a subscriber device ID code that is unique to the subscriber device 50 that 
is assigned to the subscriber. 

At step 604 the directory circuit identifies whether the subscriber's subscriber 
device 50 is served by a communication space station 24. The network location table 
245 further includes a field that may comprise the network address of the communication 
space station 24 that is then currently serving the subscriber device 50 assigned to the 
subscriber. The address wifliin this field will be updated when the subscriber moves his 
or her subscriber device 50 from one communication space station 24 to another using 
circuits and methods discussed herein. If the subscriber device 50 is not currently served 
by any communication space station 24, then the field will indicate such as represented 
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by the tenn "open". 

If at step 604, the directory circuit determines that the subscriber device 50 
assigned to the subscriber is not currently served by any communication space station 24, 
the directory circuit instructs the call signaling module 227 to establish the session on 
5 behalf of the gateway 232 such that the caller will be coupled to the voice mail module 
236 at step 612. 

If the subscriber device is served by a communication space station 24, however, 
the directory circuit at step 606 eidier: i) provides the network address of the space 
station 24 to the caller device if the caller device is coupled to the local area network 22; 

10 ii) instructs the routing circuit to jsend the call signaling messages to the space station 24 
if the caller device is a packet audio/video device coupled to the network 18; or iii) 
instructs the session signaling circuit to respond to the session signaling and establish a 
VOBP session with the space station if the caller device is coupled to the PSTN 42. 

Step 608 represents the directory circuit determining whether the response of the 

15 communication space station 24 is such that a communication session can be established 
with the communication space station 24. In certain events, such as when the subscriber 
is afready engaged in a call or if the subscriber does not answer the inboimd call, the 
directory circuit will determine that a session cannot be estabUshed with the 
communication space station 24 (either immediately if programmed to a "do-not-disturb" 

20 mode or after a brief time period of the communication space station 24 ringing (either 
audible ringing or visual ringing) but remaining unanswered). In this case, the directory 
circuit instructs the call signaling module 227 to establish the session on behalf of the 
gateway 232 such that the caller will be coupled to the voice mail module 236 at step 
612. 

25 The relay module 229 includes circuits for operating as an IP layer proxy for 

VOIP sessions between a space station 24 endpoint and a packet audio/video device 
coupled to the network 18 endpoint. 

The compression/encryption module 240 performs the translation between digital 
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audio data and compressed RTP frames, that may be encrypted, for VOIP sessions for 
which the gateway 232 is itself an endpoint (e.g. sessions between a space station 24 and 
a PSTN device and sessions between the gateway 232 and each conference participant). 
The conference mix module 237 includes an audio mixing circuit, a video routing 
5 circuit, and a conference session control circuit. The audio mixing circuit receives audio 
streams from each participating endpoint in the form of digital audio data provided by the 
compression/encryption module 240 or the PSTN interface 21 and generates digital audio 
data comprising one or more conference mix audio streams. The conference mix module 
237 provides applicable conference mix audio streams back to each participating 

10 endpoint. It is undesirable to include the voice of a participant in the conference mix 
audio stream that will be returned back to such participant's endpoint because echoes 
could occur. As such, a single conference call may require multiple conference mix 
audio streams - one for each participant that excludes such participant's own voice. 

The video routing circuit receives a video stream from each participating endpoint 

15 that has video capture capabilities in the form of digital video data provided by the 
compression/encryption module 240. The video routing circuit also provides selected 
video streams back to each participating endpoint in accordance with instructions from 
the web server 230 discussed with respect to Figures lOe-lOh. 

The conference session control circuit receives conference set up signaling 

20 messages from an initiating space station 24 that each includes a number identifying each 
conference participant. The conference session control circuit provides' session signaling 
messages to the call signaling module, each including a number identifying a conference 
participant, such that the call signaling module may establish a communication session 
between the gateway 232 and each participant. 

25 At any time during a conference session, the conference session control circuit 

may receive a message from a participating endpoint instructing the conference mix 
module 237 to secure the conference session. In response to such message, the 
conference session control circuit will instruct the call signaling module 227 to generate 
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applicable messages to begin (or continue, or at least not stop) encrypting each VOIP 
session comprising the conference session and to report which, if any, VOIP sessions 
have successfully begun encryption (or continue to be encrypted). 

After receiving a report of successful encryption, the control circuit will provide 
5 signals to the web server 230 so that the web server 230 may: a) update appUcable 

displays associated with each participating space station 24 as discussed with respect to 
Figures lOe-lOh; and, b) if all VOIP sessions are secure, send a message to each 
participating space station 24 to provide for the secure button 108 to illuminate. 

10 Voice Mail Module 

The voice mail module 236 includes circuits for providing a sequence of RTP 
frames representing appUcable audio prompts from compressed audio prompt files 233 to 
the compression/encryption module 240, receiving RTP frames from the 
compression/encryption module 240 representing the voice of the remote caller leaving a 
15 message for the subscriber, compressing the message into a digital audio file, and 

sending the digital audio file to the email module 228 for storage in the email files 247 
for later retrieval by the subscriber. 

Email Module 

20 The email module 228 maintains an email account associated with each 

subscriber. The email module 228 includes cUent circuits for interfacing with a remote 
email server. The email module 228 logs onto an account associated with each 
subscriber, obtains new email messages associated with the subscriber, and sends email 
messages drafted by the subscriber to the remote server. The email module 228 also 

25 maintains email files 247 in the storage 235 that may include an address book and an 
inbox for each subscriber. 

Webserver 
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The web server application 230 provides additional multi media communication 
services provided to each subscriber. Examples of the multi media communication 
services provided to each subscriber by the web server application 230 include: a) 
delivery of email and voice mail messages (as emailed audio files) to the communication 
space station 24 at which the subscriber's subscriber device 50 is then currently coupled; 
b) updating of the network location table 245 to assure proper routing of incoming audio 
and audio/video calls; c) proxy communication over network 18; d) delivery of multicast 
messages directed to a subscriber of the particular communication space station 24 at 
which his or her subscriber device is then currently coupled; and e) providing subscriber 
control of audio and audio/video conference calls through the packet voice gateway 232. 

The web server application 230 includes a multicast module 23 1 and an address 
translation module 3 1 . The multicast module 23 1 provides IP multicast services to 
enable the web server application 230 to deliver select communications to multiple 
communication space stations 24 simultaneously utilizing IP multicast protocols and 
without using excessive bandwidth on network 22. The address translation module 3 1 
provides address and port translation services to enable the web server 230 to provide 
each communication space station 24 with access to servers coupled to the network 18 as 
an IP layer proxy and without using higher layer resources of the control unit 12. 

In the exemplary embodiment, non streaming media communication between the 
web server application 230 and each communication space station 24 utilizes tagged data 
messages over a TCP/IP session between the web server appHcation 230 and a system 
client appHcation 115 (Figure 4) v^dthin the communication space station 24. Each 
message transfenred between the web server application 230 and the communication 
space station 24 comprises a data element and a tag identifying the significance of the 
data element. For example: a) if the data element comprises the text of an email 
message, the tag would identify the data element as the text of an e-mail message; b) if 
the data element comprises an executable script that would provide for the 
communication space station 24 to perform a certain function, the tag would identify the 
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data element as executable script and may identify the significance of the script; and c) if 
the data element comprises display layout control inforaiation (e.g. a style sheet) defining 
how another date element (such as the text of the email) should be displayed on a display 
screen, the tag would identify the data element as a style sheet. 
5 Streaming media communications between the web server application 230 (such 

as multicast streaming media messa;ges provided by the IP multicast module 23 1) and the 
client application 115 utilize a sequence of RTP frames that include compressed media 
data and are sent utilizing UDP/IP channels. 

To provide communication services to each subscriber, the web server application 
10 230 processes certain scripts in response to events generated by a communication space 
station 24 and the packet audio/video gateway 232. In processing the scripts, the web 
server appUcation 230 manajges subscriber communication data stored in the storage 235 
and provides operating instructions to commxmication space station client 24 and the 
email module 228. 

15 The flow charts of Figures 9a through 9g (which will be discussed in more detail 

herein) represent processing scripts that in aggregate provide for a subscriber to navigate 
through a layered menu to select appUcable services form the control xmit 12. The web 
server appHcation 230 maintains state information for each communication space station 
24 such that each communication space station 24 may navigate through the layered 

20 menu independently of other communication space station units 24. 

Gommunication Space Station 

Referring to Figure 3, a perspective view of an exemplary communication space 
station 24 is shown. The communication space station 24 includes a platform unit 52 
25 that operatively couples to the control unit 12 via either a wireless communication link 
between a platform unit network circuit 96 and the wireless network 22 or a direct 
network connection 23 between the platform unit 52 and the backbone network of the 
wireless network 22. 
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A plurality of functional modules 54, 56, 58, 60, and 1 1 may be coupled to the 
platform unit 52 to form an integrated multi-media communication platform. The 
platform imit 52 includes a subscriber interface docking platform 64 for coupling and 
optionally supporting one of a plurality of modular subscriber interface imits 60 to the 
5 platform xmit 52. The modular subscriber interface xmit 60a may include a plurality of 
buttons 68 in an arrangement similar to a typical telephone key pad to provide for 
subscriber input in a maimer similar to that of a traditional telephone handset. The 
modular subscriber interface 60b may include a touch panel graphic display 72 to provide 
for subscriber input through virtual buttons visible thereon. 

10 The platform unit 52 further includes a first function specific docking platform 

74a and a second function specific docking platform 74b, each of which couples to 
respective function specific modules 54 and 56. The first function specific docking 
platform 74a is a shallow platform for coupling to function specific modules that 
primarily comprise function specific buttons or other circuits that may be placed within a 

15 thin module. The second function specific docking platform 74b is a larger platform for 
coupling to function specific modules with more complex internal circuits requiring the 
additional size. 

In the exemplary embodiment, the function specific module 54 may include 

subscriber interface buttons configured for enhancing voice commxmication through the 
20 communication space station 24 such as a voice message control 76 for single button 

access to voice message files and voice management controls 86 for single button control 

of enhanced voice management functions. 

The function specific module 56 may include circuits configured for enhancing 

data communication through the communication space station 24 such as an email 
25 control 78 for single button access to subscriber email messages, a print control 80 for 

single button initiation of the printing of an email message, and a data networking port 

84. 

The platform imit 52 further includes a docking bay 62 into which a modular 
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docking interface 58 may be secured and operatively coupled to the platform xmit 52. 
The modular docking interface 58 supports one of a plurality of modular subscriber 
devices 50 within a subscriber device interface bay 66 and provides for operatively 
coupling the modular subscriber device 50 to the platform unit 52. Exemplary 
5 configurations for the modular subscriber device 50 include a subscriber data assistant 
86, a subscriber wide area network communication device 88, and the wireless LAN 
voice handset 26, each of which is discussed in more detail herein. 

While operatively coupled to the platform unit 52, the subscriber device 50 
becomes an integral part of the subscriber interface of the commimication space station 

10 24. A liquid crystal graphic display 90 on the subscriber device 50 may function to 
display multi-media communication management information under control of the 
platform unit 52 and the control unit 12. Further, programmable subscriber controls 92 
positioned adjacent to the subscriber device 50 may be configured to activate platform 
unit 52 and control unit 12 functions in accordance with the contents of the graphic 

15 display 90 adjacent to the controls 92. 

The platform unit 52 also includes docking bay 61 into which a modular video 
camera 1 1 may be coupled to the communication space station 24. The modular video 
camera 1 1 provides a video image for use by the communication space station 24 when 
participating in a video conference call. 

20 The platform unit 52 may further include one or more of the following elements: 

a) a handset 98 similar to a traditional telephone handset to provide a subscriber voice 
interface, b) a speaker 100 and a microphone 102 to provide a hands-free subscriber 
voice interface, c) a modular battery pack 70 (which fits within a battery pack bay that is 
not shown) for operating power when the communication space station 24 is uncoupled 

25 fi-om a line voltage, d) cell button 104 for single button selection of certain functions 
such as a wide area network communication function, e) help button 106 for single 
button selection of a help function, and f) a secure button 108, selection of which 
actuates encryption of the VOIP session supporting a subcriber's call from the space 

24 



station 24. 

Figure 4 shows a block diagram of the communication space station 24. The 
platform unit 52 includes an application controller 1 12 coupled to a local bus 1 16 that 
mterconnects the controller 1 12 Avith a plurality of peripheral circuits that include a 
5 wireless module 94, a power management controller 120, a communication controller 
122, a network switch controller 124, a key switch controller 126, a touch panel 
controller 128, a plain old telephone service (POTS) converter 146, and a voice 
commimication system 130. 

The v/ireless module 94 operatively couples the platform unit 52 with the control 
10 unit 12 over the wireless LAN 22 (both of Figure 1). The controller 1 12 includes 
appropriate drivers for operation of the wireless module 94. 

The power management controller 120 selectively receives input power from the 
battery pack 70 or external line voltage 134. The power management controller 120 
includes appropriate circuits for converting the input power voltage to appropriate 
15 operating power required by each component of the commimication space station 24. 
Additionally, the power management controller 120 includes appropriate circuits for 
managing charging of the battery pack 70 when the platform unit 52 is coupled to the line 
voltage 134 and generating appropriate power for operating and/or charging the modular 
docking interface 58 and the modular subscriber device 50 when coupled to the platform 
20 unit 52. 

The communication controller 122 operatively couples the modular docking 
interface 58 and the modular subscriber device 50 to the controller 112 such that the 
platform 52 can exchange data with the modular subscriber device 50. In the exemplary 
embodiment, the communication controller 122 is a serial communication controller that 
25 enables the serial exchange of data with a compatible serial communication controller 
within the modular subscriber device 50 over a physical medium. Exemplary physical 
mediums include hardwired contacts, an infrared transmission, and RF transmission, 
however other physical mediums are envisioned and which medium is used is not critical 
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to this invention. 

The communication control 122 also operatively couples the modular video 
camera 1 1 to the controller 1 12 such that the platform unit 52 may power the video 
camera 1 1 and receive the video image fiom the video camera 1 1 . 

The network switch controller 124 provides a network data port 84 which enables 
the controller 1 12 to communicate with another network computing circuit over a 
network interface. The network switch controller 124 is coupled to a bus port 135 within 
the function specific docking platform 74b for coupling to a mating port 148 on the 
function specific module 56. 

The key switch (e.g. button) controller 126 is coupled to: 1) a connector 136a 
which in turn is coupled to a mating connector on the modular subscriber interface unit 
60a (Figure 3) for interconnecting the buttons 68 to the key switch controller 126; 2) a 
connector 136b which in tum is coupled to a mating connector 142 on the function 
specific module 54 for interconnecting the buttons 76 and 86 to the key switch controller 
126; 3) the bus port 135 which in tum is coupled to a mating port 148 on the function 
specific module 56 for interconnecting the buttons 78 and 80 to the key switch controller 
126; 4) the cell button 104; 5) the help button 106; and 6) the secure button 108. In the 
exemplary embodiment, the key switch controller 126 may drive row and column signals 
to the various buttons and, upon detecting a short between a row and a column (e.g. 
button activation) reports the button activation to the application controller 1 12 over the 
bus 116. Again, the application controller 1 12 includes appropriate drivers for operating 
the key switch controller 126. 

The touch panel controller 128 is coupled to a connector 144 which in tum is 
coupled to a mating connector on the modular subscriber interface imit 60b (Figure 3) for 
interconnecting the touch panel graphic display 72 to the touch panel controller 128. In 
the exemplary embodiment, the touch panel controller 128 may include a separate 
display control circuit compatible with the resolution and color depth of the touch panel 
graphic display 72 and a separate touch panel control circuit for detecting subscriber 
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contact with the touch panel graphic display 72. The application controller 112 includes 
appropriate systems for driving the contents of the touch panel graphic display 72 
through the touch panel controller 128. 

The voice communication system 130 generates analog voice signals for driving 
5 the speaker 100 (or the speaker in the handset 98 of Figure 3) and detects input from the 
microphone 102 (or the microphone in the handset 98) under the control of the 
application controller 1 12. 

The POTS converter circuit 146 provides a standard POTS port signal (e.g. tip 
and ring) for operation of a traditional telephone or a traditional fax machine coupled to a 
10 POTS port 82 on the function specific module 56. In operation the POTS converter 146 
circuit interfaces between the POTS signal and the application controller 1 12. 

In the exemplary embodiment, the controller 1 12 executes a packet audio/video 
communication client 113 and a client application 115. The packet audio/video 
conmiunication client 113 includes a session set up circuit 118 and a 
15 compression/encryption circuit 1 14. 

The session set up circuit 118 provides for sending (and responding to) applicable 
session signaling messages to (and from) another endpoint to establish a VOIP session 
with such other endpoint. The session set up circuit 118 also provides for sending (and 
responding to) applicable session signaling messages to (and from) the gateway 232 to 
20 initiate a conference session to conference session participants. 

The compression/encryption circuit 114 exchanges the sequences of RTP frames 
representing compressed and audio data and video data, that may be encrypted, with the 
other endpoint and translates between compressed and optionally encrypted RTP frames 
and digital audio and digital video data, that may be encrypted. More specifically, the 
25 compression/encryption circuit 114 compresses video images from the video camera 1 1 
into a sequence of RTP frames for sending to the other endpoint, compresses voice 
signals from the voice communication circuit 130 into sequences of RTP frames for 
sending to the other endpoint and decompresses RTP frames of video images and audio 
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signals received from the other endpoint for driving the voice communication circuit 130 
and for displaying a video image on a display. In the exemplary embodiment, the packet 
audio/video communication client 113 may be one of the commercially available clients 
utilizing established protocols such as the International Telephone Union (ITU) H.323 
5 protocols, The Internet Engineering Task Force (IETF) Session Initiation Protocols, or 
other protocols useful for signaling and estabUshing a real time streaming media session 
with the packet audio/video gateway 232. 

The session set up module 118 includes circuits for generating and sending 
applicable messages to the other endpoint to initiate encryption of a VOIP session in 

10 response to operator activation of the secure button 108. The applicable messages will 
include negotiation of an encryption algorithm and the exchange of each endpoint*s 
public encryption key. Further, in response to successful initiation of encryption dining a 
VOIP session that is not a conference session, the session set up module 118 may 
generate an applicable signal to illuminate the secwe button 108. Further, in response to 

15 an all-secure message from the conference module 237 during a conference session, the 
module may generate the apphcable signal to illuminate the secure button 108. 

The client application 115 operates as a client to the web server application 230 
(Figure 3) within the control unit 12. The client application 115 provides for the 
controller 1 12 to: a) generate an image on the touch panel graphic display 72 or on the 

20 graphic display 90 on the subscriber device 50 in accordance with display content and a 
style sheet received from the control unit 12; b) output an audio stream file received from 
the control unit 12 through the dialog system 130; c) execute processing steps in 
accordance with instructions received from the control unit 12; d) provide messages 
indicating subscriber actions (such as subscriber activation of the cell button 104, the 

25 help button 1 06, a touch panel virtual button, or any other button on the commimication 
space station 24) to the web server appKcation 230; e) activate the packet audio/video 
chent 1 13 to set up a real time audio/video session with the packet audio/video gateway 
232 (Figure 2); f) identify the modular configuration or subscriber interface configuration 
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of the commiinication space station 24 and report the configuration to the control unit 12; 
and g) report the coupling of (and decoupling of) a subscriber device 50 and/or modules 
to the platform 52 of the communication space station 24 to the control unit 12. 

Subscriber Data Assistant 

Turning to Figure 5, exemplary structure of a subscriber data assistant 86 is 
shown. The subscriber data assistant 86 includes a controller 160 interconnected to a 
plurality of peripheral controllers by an intemal bus 162. Because of the small size and 
the portability of the subscriber data assistant 86, the touch panel 90 provides the primary 
subscriber interface. The touch panel 90 is controlled by a display controller 164 and a 
touch panel controller 166. The display controller 164 drives the liquid crystal display of 
touch panel 90 using signals compatible with the resolution and color depth of the 
display 90. The touch panel controller 166 detects user activation of the touch panel 90. 
The controller 160 operates appropriate drivers 176 for controlling operation of the touch 
panel controller 166 and the display controller 164. 

A communication controller 168 is also coupled to the bus 162 and operates 
under control of the application controller 160. In the exemplary embodiment, the 
communication controller 168 is a serial communication controller that is compatible 
with the communication controller 122 of the platform unit 52 (both of Figure 4) such 
that data communication may occur between the platform unit 52 and the subscriber data 
assistant 86 when the subscriber data assistant 86 is operatively coupled to the platform 
unit 52. 

A power management circuit 170 selectively receives input power from a battery 
pack 172 or from the power management circuit 120 in the platform imit 52. The power 
management circuit 170 includes appropriate circuits for converting the input power 
voltage to appropriate operating power required by each component of the subscriber 
data assistant 86. Additionally, the power management circuit 170 includes appropriate 
circuits for managing charging of the battery pack 172 when the subscriber data assistant 
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is coupled to the platform unit 52. 

The controller 160 also operates a communication space station cUent application 
174 for displaying multi-media communication management information under control 
the platform unit 52 when coupled to the platform unit 52. In the exemplary embodiment 
5 the communication space station client application 174 receives messages from the 
platform unit 52 in the form of tagged messages. After receipt of the tagged messages, 
the communication space station client application 174 builds a display document to 
display the communication management information represented by tagged content 
messages in accordance with a style sheet that is compatible with the size, resolution, and 

10 color depth of the touch panel display 90. The display document is then displayed on the 
touch panel display 90. 

It should be appreciated that in additional to operating the drivers 176 and the 
conmiunication space station client application 174, the controller 160 may optionally 
operate any of the software appUcations that are commercially available for personal data 

15 assistants (PDAs) which may include address book management, calendar management, 
and games. While operation of such PDA applications may be useful to the subscriber, it 
is not critical to the operation of the present invention. 

Subscriber Wide Area Network Communication Device 

20 Turning to Figure 6, exemplary structure of a subscriber wide area network 

communication device 88 is shown. The wide area network commimication device 88 
includes a controller 180 operating a Commimication Space Station application 174*, the 
subscriber contact directory application 178, a wireless conmiunication application 194, 
and applicable drivers 196 for a plurality of peripheral controllers. The controller 180 is 

25 intercoimected to the plurality of peripheral controllers by an internal bus 1 86. The 

peripheral controllers include a wide area network RF circuit 182, a voice system 197, a 
display controller 184, a touch panel controller 185, a key switch controller 193, a 
communication controller 188, and a power management system 190. 
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The wide area network RF circuit 1 82 may be a circuit for transmitting and 
receiving signals from a wide area network service provider's medium under control of 
the wireless communication application 194. Exemplary wide area network service 
provider mediums include an analog or digital cellular or PCS telephone RF system. 
5 The key switch controller 193 is coupled to the control buttons 195. The key 

switch controller 193 drives row and column signals to the control buttons 195 and, upon 
detecting a short between a row and a column indicating button activation, reports the 
activation to the controller 1 80. The control buttons may be used by a subscriber for 
operating the wide area network conmumication device 88 when uncoupled form the 

10 platform unit 52. 

The voice system 197 includes a speaker and a microphone. Under control of the 
wireless communication appUcation 194, the voice system 197 may provide a subscriber 
voice interface for an audio session with a remote device over the wide area network 
service provider's medium. 

15 The display controller 1 84 drives the display 90 using signals compatible with the 

resolution and color depth of the display 90. The display 90 may optionally be a touch 
panel display 90 and the touch panel controller 185 detects user activation of the touch 
panel 90. 

The communication controller 188 may be a serial communication controller 
20 compatible with the communication controller 122 in the platform vmit 52 such that data 
communication may occur between the platform unit 52 and the wide area network 
communication device 88 when the wide area network communication device 88 is 
operatively coupled to the platform imit 52. 

The power management controller 190 operates with a battery pack 192, both of 
25 which may operate in a similar manner to the power management controller 170, and the 
battery pack 172 discussed with reference to Figure 5. 

Similar to the subscriber data assistant 86 (Figure 5), when the wide area network 
communication device 88 is coupled to the platform unit 52, the Communication Space 
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Station application 174' provides for displaying multi-media communication 
management information under control of the platform unit 52 and provides for multi- 
media communication directly between the platform unit 52 and the wide area network 
service provider medium. 
5 In addition the Communication Space Station application 174' may receive 

messages from the platform unit 52 which may be multi-media communication messages 
for communication over the wide area network service provider medium. Each message 
includes a tag that identifies the contents of the message. After receipt of a tagged 
message, the Communication Space Station application 174' may identify whether the 

10 message is for cormnunication with the wide area network service provider medium or 
whether it is multi-media communication management information for display. 

When the message is for communication with the wide area network service 
provider medium, the Communication Space Station application 174' will reformat the 
message to a format compatible with wide area network service provider medium 

15 transmission standards and transmit the message using the wide area network RF circuit 
182. 

The wide area network communication device 88 may also receive signals from 
the wide area network service provider medium via the wide area network RF circuit 
182. When received, the Communication Space Station application 174' reformats the 
20 messages into a plurality of tagged messages for communication to the platform unit 52 
and sends the tagged messages to the platform unit 52 via the communication controller 
188. 

Wireless Voice Handsets 

25 Figure 7 shows a block diagram of an exemplary wireless dialog handset 26. The 

wireless voice handset 26 includes a network circuit 278 and a controller 250 that 
operates a Communication Space Station application 174", the subscriber contact 
directory application 178, a LAN communication appUcation 252, and applicable drivers 
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254 for each of a plurality of peripheral controllers. The controller 250 is interconnected 
by a bus 276 to the plurality of peripheral controllers which include a module controller 
258, a display driver 260, a touch panel driver 261, a key switch controller 264, and a 
power management circuit 270. 
5 The module controller 258 operatively couples the network circuit 278 to the 

controller 250 such that the wireless voice handset 26 may communicate with the control 
unit 12 over the wireless LAN 22 (both of Figure 1). In the exemplary embodiment, the 
module controller 258 may be a PCMCIA controller circuit and the network circuit 278 
is configured as a PCMCIA card that couples to the module controller 258 through a 
10 PCMCIA connector 272. The LAN commxmication application 252 operates the network 
circuit 278 for commxmicating with the control unit 12 using appropriate wireless 
signaling protocols. 

The key switch controller 264 is coupled to the control buttons 266. The key 
switch controller 264 drives row and column signals to the control buttons 266 and, upon 

15 detecting a short between a row and a column indicating button activation, reports the 
activation to the controller 250. The control buttons may be used by a subscriber for 
operating the wireless voice handset 26 when uncoupled form the platform unit 52. 

The display controller 260 drives the display 90 (optionally a touch panel display 
90) using signals compatible with the resolution and color depth of the display 90. The 

20 touch panel controller 261 detects user activation of the touch panel display 90. The 
power management controller 270 operates in conjunction with a battery pack 268, both 
of which may operate in a similar manner to the power management controller 170, and 
the battery pack 172 discussed with reference to Figure 5. 

When the wireless voice handset 26 is coupled to the platform unit 52, the 

25 Communication Space Station appUcation 174" provides for displaying multi-media 
communication management information under control the platform unit 52. 
Additionally, the Communication Space Station appHcation 174" may receive multi- 
media communication management information content messages and control messages 
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directly from the control unit 12 via the wireless network 22. After receipt of the tagged 
messages from either the platform unit 52 or the control unit 12, the Communication 
Space Station application 174'' builds a docmnent to display the commimication 
management information represented by the tagged content messages in accordance with 
5 display layout control messages that are compatible with the size, resolution, and color 
depth of the touch panel display 90. The display document is then displayed on the touch 
panel display 90. 

Web Server Application 

10 Referring to Figures 9a through 9j in conjunction with Figure 2, exemplary 

processing steps performed by the web server application 230 to provide commimication 
services to a communication space station 24 are shown. 

The flowchart of Figure 9a represents steps performed by the web server 
application 230 upon receiving an open session request on a predetermined port from a 

15 communication space station 24 that has just been operatively coupled to the network 22, 
obtained a network address from the network address server 220, and is ready to operate 
as a client to the web server application 230. Step 300 represents receipt of the open 
session request and step 302 represents establishing a TCP/IP session with the 
conmiunication space station 24, 

20 Step 304 represents sending a start up script to the commimication space station 

24. The start up script includes instructions that, when executed by the client application 
115, provide for the communication space station 24 to detect its subscriber interface 
configuration (e.g. whether the communication space station 24 includes a display screen 
and what capabilities such as video capabilities and graphic resolution capabilities the 

25 display screen may have) and to report its subscriber interface configuration back to the 
web server application 230. 

Step 306 represents receipt of the subscriber interface configuration of the 
communication space station 24 from the communication space station 24 and step 308 
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represents writing an indication of the subscriber interface configuration of the 
communication space station 24 to a subscriber interface table 239 in the storage 235. 

Step 310 represents retrieving a main menu display style sheet from a selection of 
style sheets 241 stored in the storage 235. The retrieved main menu display style sheet 
5 will be a style sheet that corresponds to the subscriber interface configuration of the 
communication space station 24. 

Step 3 12 represents providing main menu display content and the style sheet to 
the communication space station 24 and step 314 represents updating a communication 
space station state table 243 in the storage 235 to indicate that the conmiunication space 
10 station 24 is in a main menu state. 

It should be appreciated that the main menu content provided to the 
communication space station 24 is independent of the subscriber interface, howrever, the 
style sheet provided to the communication space station 24 is dependent on the 
subscriber interface. For example, turning to Figure 10a which represents display of a 
15 main menu on a subscriber device 50 in the modular docking interface 58 the content of 
the main menu display includes a title of main menu and choices of view email, voice 
mail, and multi cast paging. The style sheet corresponding to a subscriber interface that 
includes a subscriber device 50 provides for the content to be graphically displayed with 
the title at the top and each menu choice to be displayed adjacent a button 92 on the 
20 modular docking interface 58, Alternatively, turning to Figure 10b which represents 

display of a main menu on a display 72 that is coupled to a communication space station 
interface 64 (Figure 3), the content of the main menu display again includes a title of 
main menu and the choices of view email, voice mail, and multi cast paging. However, 
the style sheet that corresponds to a subscriber mterface that includes a display 72 that is 
25 coupled to a communication space station interface 64 provides for the content to be 

graphically displayed with the title at the top and each choice to be displayed in a vertical 
list with an adjacent numeral for selection using the keypad 68 (Figure 3). The examples 
shown in Figures 10a and 10b are for illustrative purposes only. Other subscriber 
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interface configurations that include non-graphic displays, bit mapped multi line text 
displays, or 7 element single or multi line text displays may utilize different style sheets 
for displaying all or a portion of the main menu content. 

The flowchart of Figure 9b represents steps performed by the web server 
application 230 upon receiving an indication that a subscriber device 50 has been 
coupled to a communication space station 24. Step 3 16 represents receipt of such 
indication. 

Step 318 represents sending a device ID extraction script to the communication 
space station 24. The device ID extraction script includes instructions that, when 
executed by the client application 115, provide for the communication space station 24 to 
interrogate the subscriber device 50 to determine its device identification (e.g. an 
identification of which subscriber to which the device has been assigned) and to report 
the device identification back to the web server apphcation 230. 

Step 320 represents receipt of the device identification back fi-om the 
communication space station 24 and step 322 represents associating the device ID with 
the communication space station 24 in the network location table 245 in the storage 235. 
As discussed previously, the packet audio/video gateway 232 utilizes the network 
location table 245 for routing incoming telephone calls to the particular commxmication 
space station 24 at which a subscriber's subscriber device 50 is then currently coupled. It 
should be appreciated that this step 322 provides for the network location table 245 to 
properly indicate association between a communication space station 24 and the 
subscriber device 50 that is served thereby. 

Because the style sheet selected for display of content on the communication 
space station 24 is dependent on the subscriber interface configuration of the 
communication space station 24 as determined by the subscriber interface table 239, the 
table should be updated when the subscriber interface configuration changes. Coupling a 
subscriber device 50 to a communication space station 24 changes the subscriber 
interface because the display of the subscriber device 50 becomes a display for the 
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communication space station 24. As such, step 324 represents updating the subscriber 
interface configuration of the communication space station 24 in the subscriber interface 
table 239. 

Step 326 represents retrieving a main menu display style sheet that is applicable 
5 to the new subscriber interface configuration fi-om the selection of style sheets 241 in the 
storage 235 and step 328 represents providing main menu display contend and the style 
sheet to the communication space station 24. Step 330 represents updating the 
commimication space station state table 243 to assure that it represents that the 
communication space station 24 is in the main menu state. 
10 The flow chart of Figure 9c represents steps performed by the web server 

application 230 upon receiving an indication that a subscriber device 50 has been 
removed fi'om a communication space station 24. Step 322 represents receipt of such an 
indication. 

Because the packet audio/video gateway 232 utilizes the network location table 
15 245 for routing incoming telephone calls to the particular communication space station 
24 at which a subscriber's subscriber device 50 is then currently coupled, the network 
location table should be updated upon removal of a subscriber device form a 
communication space station 24. Step 334 represents disassociating the subscriber 
device 50 fi'om the communication space station 24 in the network location table 245. 
20 Because the display on the subscriber device 50 is no longer part of the subscriber 

interface of the communication space station 24 after the subscriber device 50 is 
removed, step 336 represents updating the subscriber interface configuration table 239. 

Step 338 represents retrieving a main menu display style sheet that is appUcable 
to the subscriber interface configuration without the subscriber device 50 from the 
25 selection of style sheets 241 in the storage 235 and step 340 represents providing main 
menu display content and the style sheet to the communication space station 24. Step 
342 represents updating the communication space station state table 243 to assure that it 
represents that the communication space station 24 is in the main menu state. 

37 



The flowchart of Figure 9d represents steps performed by the web server 
application 230 upon receiving a subscriber indication of a command to view subscriber 
email messages. The means by which the commimication space station 24 may detect 
such a subscriber indication is dependent on the subscriber interface configuration of the 
5 communication space station 24. For example, if the subscriber interface includes the 
email button 78 (Figure 3), detection of button 78 activation would be a subscriber 
indication of a command to view subscriber email messages. Similarly, subscriber 
activation of the email menu choice on the main menu either by touch panel activation or 
by activation of a button associated with the menu choice (either or both of which may be 

10 applicable dependent on the subscriber interface configuration) would be a subscriber 
indication of a command to view subscriber email messages. Step 344 represents the 
web server application 230 receiving the subscriber indication of a conmiand to view 
subscriber email messages. 

Step 346 represents instructing the email module 228 to logon to an email server 

15 (which may be a remote email server coupled to the network 18) and to receive new 

email messages associated with the subscriber's account. Step 348 represents writing the 
new email messages to the subscriber inbox in the email files 247 in the storage 235. In 
an embodiment wherein the remote email server maintains subscriber inbox information, 
steps 346 and 348 may be viewed as synchronizing the email messages between the 

20 remote server and the email files 247. It should also be appreciated that the email 

module 228 may periodically retrieve new email messages and write to the subscriber 
inbox independently of whether the subscriber has activated an email control. As such, 
the inbox will already include new messages and steps 346 and 348 may not need to be 
performed in response to event 344. 

25 Step 350 represents retrieving inbox content fi-om the email files 247 and step 352 

represents retrieving an inbox style sheet that is appUcable to the subscriber interface 
fi*om the style sheets 241 in the storage 235. Because the subscriber's voice mails will be 
sent to the subscriber's email account as audio files, it is possible that the email messages 
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retrieved at step 346 will include both text based emails and emails from the voice mail 
server 236. Because the subscriber activated a command to view email messages, tiie 
inbox style sheet provides for the display of the email messages received from senders 
other than the voice mail server 236 to be displayed first (or on the top of the display). 
5 Step 354 represents providing the inbox content and style sheet to the 

communication space station 24 and step 356 represents updating the communication 
space station state table 243 to indicate that the conmiunication space station 24 is in an 
email state. 

The flowchart of Figure 9e represents steps performed by the web server 

10 application 230 receiving a subscriber indication of a command to obtain voice mail 
messages. Again, the means by which the communication space station 24 may detect 
such a subscriber indication is dependent on the subscriber interface configuration of the 
communication space station 24. For example, if the subscriber interface includes the 
voice mail button 76 (Figure 3), detection of button 76 activation would be a subscriber 

15 indication of a command to obtain voice mail messages. Similarly, subscriber activation 
of the voice mail menu choice either by touch panel activation or by activation of a 
button associated with the menu choice would be a subscriber indication of a command 
to obtain voice mail messages. Step 358 represents the web server application 230 
receiving the subscriber indication of a command obtain voice mail messages. 

20 Because voice mail messages will be sent as audio files form the voice mail 

server 236 to the subscriber's email account, step 360 represents instructing the email 
module 228 to logon to the email server and to receive new email messages associated 
with the subscribers account. Step 362 represents writing the new email messages to the 
subscriber inbox in the email files 247 in the storage 235. 

25 Step 364 represents retrieving inbox content from the email files 247 and step 366 

represents retrieving an voice mail style sheet that is applicable to the subscriber 
interface from the style sheets 241 in the storage 235. Because the email messages that 
include voice mail audio files from the voice mail server 236 may be intermixed with 
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email messages from other senders, the voice mail style sheet provides for only the 
display of the voice mail messages received from the voice mail server 236. 

Step 368 represents providing the inbox content and the voice mail style sheet to 
the commimication space station 24 and step 370 represents updating the communication 
5 space station state table 243 to indicate that the communication space station 24 is in a 
voice mail state. 

The flowchart of Figure 9f represents steps performed by the web server 
application 230 upon receiving a subscriber indication of a command to initiate a 
multicast paging message. The communication space station 24 may detect such a 
10 subscriber indication by various means, such as touch panel activation of button 

activation of a menu selection on the main menu, dependent on the subscriber interface 
configuration of the communication space station 24. Step 372 represents the web server 
application 230 receiving the subscriber indication of a command to initiate a multicast 
paging message. 

15 Step 374 represents retrieving the subscriber's address book content 249 from the 

email files 247. Turning briefly to Figure 8b, the address book content 249 may 
comprise a pluraUty of records with each record including a group identification name 
and identification of each subscriber in such group, and, if the group identifies a single 
person, contact information for the person. 

20 Step 376 represents retrieving a select paging group style sheet that corresponds 

to the subscriber interface of the communication space station 24 and step 378 represents 
providing both the address book content and the select paging group style sheet to the 
communication space station 24. Step 380 represents updating the communication space 
station state table 243 to indicate that the communication space station 24 is in the select 

25 paging group state. 

Figure 10c represents an exemplary display of the select paging group content 
utilizing a style sheet that may be applicable for use on a display 72 wherein the 
subscriber may use buttons or touch panel activation may be utilized to select one or 

40 



more paging groups to include in the multicast page. It should be appreciated that some 
paging groups may include only a single name such that individuals may be selected to 
include in the multicast page. Because the list of groups included in the paging group 
content may be larger than can be displayed on the display 72, the style sheet may 
5 provide for only a portion of the content to be displayed along with touch activated scroll 
controls for display of the remainder of the content. The style sheet may further include 
touch activated controls to return to the main menu and to start the multicast message. 

Figure lOd represents an exemplary display of the select paging group content 
utilizing a style sheet that may be applicable for display of the content on a display of a 

10 subscriber device 50 coupled in the modular docking interface 58. Because subscriber 
selection is to be by activation of buttons 92, the style sheet provides for the content to be 
displayed with the groups on the left side for selection by buttons 92 on the left side of 
flie modular docking interface 58 and for indicators to label the function of the buttons 92 
on the right side of the modular docking interface 58 such as scroll up, scroll down, start 

15 message, and return to main menu. 

The flowchart of Figure 9g represents steps performed by the web server 
application 230 upon receiving a subscriber indication of a command to start the 
mxilticast paging message. Step 384 represents receipt of such a subscriber indication 
along with identification of the subscriber selected multicast groups to include in a 

20 multicast recipient list. 

Steps 388 through 394 represent steps that are performed by the web server 
application 230 for each recipient. Such steps may be performed in sequence or in 
parallel. For purposes of illustration, the steps are shown performed in sequence. Step 
388 represents identifying the subscriber device 50 that is associated with the recipient 

25 and determining if the subscriber device is then currently coupled to a communication 
space station 24. If yes, step 390 represents inviting such communication space station 
24 to the multicast session group. However, if the subscriber device 50 associated with 
the recipient is not coupled to a conmumication space station 24 where the subscriber 
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may receive the multicast, then at step 389 the recipient is added to an email list. 

Following step 390, step 392 represents determining whether the communication 
space station 24 joined the multicast session group. If the communication space station 
24 is operating a voice session, it would be inappropriate to interrupt the voice session 
with a multicast page for the subscriber. As such, it is envisioned that the 
communication space station 24 may, when in certain operational states, not join flie 
multicast session group. In which case, the recipient is added to the email list at step 
393. At this time, the voice mail module 236 is invited to the multicast session group to 
receive the multicast on behalf of each recipient added to the email list at step 389 or 
393. 

After the recipient is either added to the email list at step 393 or the 
communication space station 24 joined the multicast session group at step 392, step 394 
represents determining if steps 388 though 392 must be performed for additional 
recipients. If not, step 396 represents establishing a RTP channel with the 
communication space station 24 that initiated the multicast paging message and step 398 
represents instructing the web server 230 to prompt the subscriber to begin the multicast 
paging message. 

Step 400 rq)resents multicasting the message to the session group utilizing the 
multicast module 231 and step 402 represents instructing the voice mail module 236 to 
terminate the multicast, build an audio file, and send the audio file by email to each 
recipient that was added to the email list at either step 389 or 393. 

The flowchart of Figure 9h represents steps performed by the web server 230 
upon receiving a subscriber indication of a command to initiate an audio or an 
audio/video conference call from a communication space station 24. The communication 
space station 24 may detect such a subscriber indication by various means, such as by 
subscriber activation of the conference call control 502 on the touch panel 72 of Figure 
10b or by activation of a button 92 corresponding to the conference call menu selection 
on the display screen 50 of Figure 10a. Step 404 represents the web server 230 receiving 
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such an indication from a communication space station 24. 

Step 406 represents retrieving the subscriber's address book content 249 from the 
email files 247 and step 408 represents retrieving a "select conference session 
participants" that corresponds to the subscriber interface of the communication space 
station 24 from the style sheets 241 in the storage 235. Step 410 represents providing 
both the address book content and the style sheet to the communication space station 24 
for display. 

Step 412 represents receiving subscriber selection of participants for the 
conference call. Figure lOe represents an exemplary display of the address book for 
selection of conference call participants on the touch panel 72. The communication 
space station 24 may detect subscriber activation of the touch panel 72 to "highhght" 
conference call participants and indicate that selection is complete by activating a 
finished control 512. Upon activation of the finish control 512, the communication space 
station 24 will provide the subscriber selection of participants to the web server 230. 

Step 414 represents instmcting the session set up module 1 18 to initiate a 
conference call by providing the session participant list to the packet audio/video 
gateway 232 as discussed above and step 416 represents updating the state of the 
communication space station 24 to a conference call state. 

After receiving the session participant hst from the web server 230, the packet 
audio/video gateway 232, or more specifically the call signaling module 227 (Figure 2) 
will estabHsh applicable audio and video communication channels with those 
communication space stations 24 that are serving subscriber devices associated with the 
participants in accordance with the steps discussed with respect to Figure 1 la. With the 
communication channels open, the packet voice gateway 232 will activate the conference 
mix module 237 to begin mixing the audio streams from each communication space 
station 24 participating in the conference call and will report the status of each 
participant to the web server 230 as discussed above. More specifically, the status will 
include an indication of whether each session participant is connected to the conference 
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or is inactive (not connected to the conference) and will include an indication of whether 
each session participant is on a secure VOIP session with the packet voice gateway 232. 
As will be discussed later, the status may also indicate whether the participant has 
stopped providing an active audio stream (e.g. put his or her phone on mute) and may 
5 indicate whether the conference mixing module 237 has suspended sending a conference 
mix to the participant (e.g. the packet audio/video gateway 232 has placed a particular 
participant on hold for a time period to so that others can converse without such 
participant hearing the conversation). 

The flowchart of Figure 9i represents steps performed by the web server 

10 application 230 upon receiving conference status content from the packet audio/video 
gateway 232. Step 418 represents receipt of the status content Step 419 represents 
retrieving a "status" style sheet form the style sheets 241 in the storage 235 and step 420 
represents providing the status content and the style sheet to at least the initiating 
communication space station 24 and optionally, to other communication space stations 

15 24 participating in the conference call. It should be appreciated that the steps for the 
flowchart of Figure 9i may be repeated several times during the duration of a conference 
call as the status of each participant changes. 

Figure lOf represents an exemplary display of the status of each participant on the 
touch panel 72. The display includes a vertical listing of each participant and an 

20 indication of the participants status in a column 5 14. An "A'' indicates that the 

participant is active (e.g. sending a non-mute audio stream and receiving a conference 
mix audio stream). An "I" indicates that the psuticipant is not on the conference call. A 
"M" indicates that the participant has muted his or her telephone and is not sending an 
audio stream. An indicates that the participant has been placed on hold by the 

25 initiating communication space station and is not receiving a conference mix. 

The display also includes a video indication column 516. This column indicates 
which participants are not sending a video image signal to the packet voice/video 
gateway 232 (e.g. the "O" symbol). Because the subscriber may select which of the 
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participants to view during a video conference, the video column 516 will also indicate 
the subscribers selection of the video image to view if the subscriber activates the video 
control 520. In the exemplary display, the symbol associated with Dave indicates 
that the subscriber would view the video image provided by Dave's communication 
5 space station 24 upon activating the video control 520. The subscriber may change such 
selection by utilizing the controls of the touch panel 72. Upon detecting activation of the 
video control, the communicating space station 24 will report the indication to the web 
server application 230. 

The display also includes a hold control 522. The initiating subscriber may 

10 indicate his or her desire to place a participant(s) on hold status by highlighting the 

participant(s) and activating the hold control 522. Upon detecting activation of the hold 
control 522, the communication space station 24 will report the indication to the web 
server application 230. Upon receiving the indication, the web server application 230 
will provide the indication to the packet voice/video gateway 232 which will place the 

15 selected participant(s) on hold status and return updated status content to the web server 
application 230. 

The display further includes a secure/encryption indication colxmm 518. Symbols 
in the column 518 indicate whether communications between the associated participant 
are over a secure VOIP session. A indicates that such communications are secure 

20 while a **>F' indicates that commimications v^th the associated participant are not secure. 
The flow chart of Figure 9j represents steps performed by the web server 230 
upon receiving a subscriber indication of a video image selection from a communication 
space station 24. Step 426 represents such receipt by the web server 230. Step 428 
represents providing the video image selection to the packet voice/video gateway 232. 

25 The packet voice/video gateway 232 will then begin relaying the selected video image to 
the subscriber station. Step 430 represents the web server application 230 retrieving a 
style sheet for the display of the video image. Step 432 represents providing the style 
sheet to the communication space station 24 and step 434 represents providing 
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instructions to display the video image received from the packet voice/video gateway 232 
in conjunction with the style sheet. 

Figure lOg represents an exemplary display of a single video image on the touch 
panel 72. The display will include a control to return to the status page which, when 
5 activated, will cause the communication space station 24 to retum to the display of 
Figure lOf The display includes an indication 524 that the communication with the 
displayed person is secure. 

The display will also include a scroll video control 530 which, when activated 
will cause the communication space station 24 to report such activation to the web server 
10 230. The web server 230 perfomis the steps discussed with respect to Figure 9 with the 
selected image scrolled by one video image. 

The display will also include a Vi video control 528 which, when activated will 
cause the communication space station 24 to report such activation to the web server 
application 230. The web server application 230 will perform the steps discussed with 
15 respect to Figure 9 but the packet voice/video gateway 232 will provide a mixed video 
image comprising each of four video images arranged in the four comers of the display 
as represented by Figure lOh. 

From any of the displays associated with the conference call (e.g. Figure lOe, 
Figure lOf, Figure lOg, and Figure lOh, termination of the call will cause the 
20 communication space station 24 to retum to the main menu as represented by Figures 10a 
or 10b. 

The systems and methods of the invention provide enhanced conference call 
services to subscribers of the multimedia communication management system of the 
invention. Although the invention has been shown and described v^th respect to certain 
25 preferred embodiments, equivalents and modifications will occur to others skilled in the 
art upon the reading and understanding of the specification. Those skilled in the art may 
envision other processing states, events, and processing steps to further the objectives of 
the modular multi-media communication management system of the invention. The 
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invention includes all such equivalents and modifications, and is limited only by the 
scope of the following claims. 

Other embodiments are within the scope and spirit of the appended claims. For 
example, due to the nature of software, functions described above can be implemented 
using software, hardware, firmware, hardwiring, or combinations of any of these. 
Features implementing functions may also be physically located at various positions, 
including being distributed such that portions of functions are implemented at different 
physical locations. For example, modules for encryption, such as for storing public 
encryption keys, may be disposed in the subscriber's device 50, the communication space 
station 24, or the control unit 12. Further, indicia that communications are secure may be 
provided by a module in the space station 24 instead of by the mix module 238 of the 
controller 12. 

What is claimed is: 
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